AU/ACSC/ANGERMAN/AY09 


AIR  COMMAND  AND  STAFF  COFFEGE 
AIR  UNIVERSITY 


AN  EXPLORATION  OF 

ADVANCED  DISTRIBUTED  LEARNING  SERVICE 
SUCCESS  MEASURES  FOR  SOCIAL  POLICY 


by 

William  S.  Angerman,  Major,  United  States  Air  Foree 

A  Researeh  Report  Submitted  to  the  Faeulty 
In  Partial  Fulfillment  of  the  Graduation  Requirements 

Advisor:  Fieutenant  Colonel  James  E.  Pareo,  Ph.D. 

Maxwell  Air  Foree  Base,  Alabama 
April  2009 


Distribution  A:  Approved  for  public  release;  distribution  unlimited. 


Report  Documentation  Page 


Form  Approved 
0MB  No.  0704-0188 


Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 
VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  0MB  control  number. 


1.  REPORT  DATE 

APR  2009 


2.  REPORT  TYPE 

N/A 


3.  DATES  COVERED 


4.  TITLE  AND  SUBTITLE 

An  Exploration  of  Advanced  Distributed  Learning  Service  Success 
Measures  for  Social  Policy 

6.  AUTHOR(S) 


7.  PEREORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Air  Command  And  Staff  College  Air  University  Maxwell  Air  Force  Base, 
Alabama 


5a.  CONTRACT  NUMBER 


5b.  GRANT  NUMBER 


5c.  PROGRAM  ELEMENT  NUMBER 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


5f.  WORK  UNIT  NUMBER 


8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES)  10.  SPONSOR/MONITOR’S  ACRONYM(S) 

11.  SPONSOR/MONITOR’S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release,  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

The  original  document  contains  color  images. 

14.  ABSTRACT 

Since  the  turn  of  the  century,  the  military  has  leveraged  computer  networks  and  online  media  to 
modernize  its  training  capabilities.  Goals  of  this  effort  have  been  to  create  interoperable  reusable  learning 
content,  promote  widespread  collaboration,  lower  development  costs,  and  provide  the  ability  to  deliver 
efficient  and  effective  high-quality  learning  anytime,  anywhere.  The  Air  Force  has  used  its  web-based 
online  training  system,  the  Advanced  Distributed  Learning  Service  (ADLS),  to  train  and  track  a  number  of 
social  policy  topics  such  as  the  Law  of  Armed  Conflict,  ethics  training,  violence  prevention,  etc.  This 
research  attempts  to  provide  an  overall  assessment  of  whether  ADLS  is  efficient  and  effective  with  regard 
to  social  policy  training  goals.  Research  uncovered  that  while  authority  mandates  are  being  met.  Air  Force 
ADLS  implementation  is  probably  hampering  social  policy  learning.  Currently,  social  policy  is 
marginalized  by  an  organizational  focus  on  technology  and  management  efficiencies  over  effective  learning 
outcomes.  Other  problems  include  disorganized  presentation,  strategic  leadership  deficiencies,  and 
organizational  culture  barriers.  On  a  positive  note,  recent  Air  Education  and  Training  Command 
objectives  appear  to  trend  toward  an  increased  emphasis  on  the  learners  perspective.  This  research 
presents  two  paradigms,  the  Social  Policy  Kill  Chain  and  the  Learner  in  the  Loop,  to  help  identify  and 
balance  Air  Force  organizational  and  learner  perspectives  and  needs.  Practical  recommendations  for  social 
policy  training  process  improvement  and  further  research  are  provided. 


15.  SUBJECT  TERMS 


16.  SECURITY  CLASSIFICATION  OF: 


a.  REPORT 

unclassified 


b.  ABSTRACT 

unclassified 


c.  THIS  PAGE 

unclassified 


17.  LIMITATION  OF 

18.  NUMBER 

ABSTRACT 

OE  PAGES 

SAR 

52 

19a.  NAME  OE 
RESPONSIBLE  PERSON 


standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Disclaimer 


The  views  expressed  in  this  aeademie  research  paper  are  those  of  the  author(s)  and  do  not 
reflect  the  official  policy  or  position  of  the  United  States  government  or  the  Department  of 
Defense.  In  accordance  with  Air  Force  Instruction  51-303,  it  is  not  copyrighted,  but  is  the 
property  of  the  United  States  government. 


Contents 


Page 

Disclaimer . ii 

List  of  Illustrations . v 

List  of  Tables . vi 

Prefaee . vii 

Abstract . viii 

Introduction . I 

Research  Origins . I 

Research  Questions,  Methodology,  and  Assumptions . 2 

Researeh  Boundaries . 2 

Researeh  Relevanee . 3 

Baekground . 5 

Synopsis  of  E-Leaming  for  DoD . 5 

Progression  of  Advaneed  Distributed  Learning  Serviee  (ADLS) . 6 

Soeial  Poliey  Content  on  ADLS . 8 

Learning  as  Related  to  Soeial  Poliey . 10 

Domains  of  Learning . 10 

Organizational  Culture  Impact  to  Learning . II 

Multimedia  Learning . 12 

Analysis . 13 

State  of  Soeial  Poliey  Training  on  ADLS . 14 

Overemphasis  on  Efficient  Output  over  Effeetive  Outeomes . 14 

Disorganized  Presentation  and  Deficiencies  in  Strategic  Eeadership . 17 

Organizational  Culture  Barriers . 20 

Overriding  Eoeus  on  Teehnology . 20 

Paradigms  of  Soeial  Poliey  Training . 22 

Soeial  Poliey  Kill  Chain . 22 

Eearner  in  the  Eoop . 23 

Way  Ahead  for  Air  Eoree  Teaming . 23 

Conelusions . 25 

Researeh  Contributions . 25 

hi 


Recommendations 


,26 


Appendix  A . 31 

Summary  Analysis  Tables . 31 

Appendix  B . 35 

Effectiveness  &  Efficiency  Success  Measures  for 

ADE  Systems  and  Organizations . 35 

Bibliography . 40 


List  of  Illustrations 


Figure  1 :  The  DoD  Advaneed  Distributed  Learning  System  Continuum/ Arehitecture . 6 

Figure  2:  ADLS  Weekly  Course  Completions . 7 

Figure  3:  ADLS  Soeial  Policy  Course  Offering  by  ADLS  Categories . 9 

Figure  4:  Taxonomy  of  Cognitive  Domain . 11 

Figure  5:  Taxonomy  of  Affective  Domain . 11 

Figure  6:  Learning  as  Info  Transfer . 12 

Figure  7:  Learning  as  Complex  Integrative  Process  Transfer . 12 

Figure  8:  Perspectives  of  ADLS  Social  Policy  Success . 13 

Figure  9;  Balanced  Scorecard  Strategic  Planning  and  Management  System . 28 

Figure  10;  Cross-Cultural  Competence  Model . 28 

Figure  11;  Boyd’s  OODA  Loop,  adapted  by  William  P.  Hall . 30 

Figure  12;  DoD  Success  Criteria  for  ADL . 35 

Figure  13;  DoD  View  of  Organizational  ADL  Success . 36 


List  of  Tables 


Table  1:  ADLS  Social  Policy  Learning  Research  Vectors . 2 

Table  2:  Air  Force  ADLS  Social  Policy  “Success”  is  Relative  to  Participant . 31 

Table  3:  Summary  of  ADLS  Social  Policy  Makers,  Mandates,  and  Effectiveness . 32 


Preface 


My  first  impression  after  being  plaeed  in  the  DoD  Soeial  Policy  Perspectives  2010 
research  elective  at  ACSC  was,  “What  have  I  gotten  myself  into?”  Now,  in  retrospect.  I’m  very 
happy  to  have  stuck  with  it  despite  initial  thoughts  of  switching  seminars  and  subsequent 
squirming  during  discussions  outside  my  normal  comfort  zone. 

My  thanks  go  to  my  advisors,  Lt  Col  Parco  and  Lt  Col  Jenkins,  for  making  the  elective 
and  associated  research  an  interesting  and  rewarding  experience.  I’m  grateful  for  the  care  in 
instruction  and  facilitation,  concern  for  student  welfare,  and  personalized  feedback  they’ve 
provided  in  the  last  year. 

I  offer  my  sincere  appreciation  to  AETC  and  the  ADLS  program  office  for  their 
cooperation  in  answering  my  questions,  sharing  historical  perspectives,  and  supplying 
background  for  my  research. 

I  would  also  like  to  thank  Sumanth,  the  Microsoft  technician  from  India,  who  recovered  a 
critical  corrupted  document  and  saved  me  a  lot  of  work.  His  skillful  assistance  professionally 
rendered  during  a  stressful  time  was  great. 

Finally,  and  most  importantly,  I  owe  a  huge  thank  you  (and  more  than  a  little  extra  family 
time)  to  my  wonderful,  wonderful  wife  and  two  boys  for  putting  up  with  me  during  the  research 
and  writing  of  this  paper.  Without  their  unconditional  love  and  support,  this  effort  would  not 
have  been  possible. 


vii 


AU/ACSC/14-4501/2009 


Abstract 

Since  the  turn  of  the  eentury,  the  military  has  leveraged  eomputer  networks  and  online 
media  to  modernize  its  training  eapabilities.  Goals  of  this  effort  have  been  to  ereate 
interoperable  reusable  learning  eontent,  promote  widespread  eollaboration,  lower  development 
eosts,  and  provide  the  ability  to  deliver  effieient  and  effeetive  high-quality  learning  anytime, 
anywhere.  The  Air  Foree  has  used  its  web-based  online  training  system,  the  Advaneed 
Distributed  Learning  Serviee  (ADLS),  to  train  and  traek  a  number  of  soeial  poliey  topies  sueh  as 
the  Law  of  Armed  Confliet,  ethies  training,  violenee  prevention,  ete.  This  researeh  attempts  to 
provide  an  overall  assessment  of  whether  ADLS  is  effieient  and  effeetive  with  regard  to  soeial 
poliey  training  goals. 

Researeh  uneovered  that  while  authority  mandates  are  being  met.  Air  Foree  ADLS 
implementation  is  probably  hampering  soeial  poliey  learning.  Currently,  soeial  poliey  is 
marginalized  by  an  organizational  foeus  on  teehnology  and  management  effieieneies  over 
effeetive  learning  outeomes.  Other  problems  inelude  disorganized  presentation,  strategie 
leadership  defieieneies,  and  organizational  eulture  barriers.  On  a  positive  note,  reeent  Air 
Edueation  and  Training  Command  objeetives  appear  to  trend  toward  an  inereased  emphasis  on 
the  learner’s  perspeetive. 

This  researeh  presents  two  paradigms,  the  Soeial  Poliey  Kill  Chain  and  the  Learner  in  the 
Loop,  to  help  identify  and  balanee  Air  Foree  organizational  and  learner  perspeetives  and  needs. 
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Practical  recommendations  for  social  policy  training  process  improvement  and  further  research 
are  provided. 


IX 


Introduction 


Efficiency  is  doing  things  right.  Effectiveness  is  doing  the  right  things. 

— Peter  Drucker 

Efficiency  tends  to  deal  with  Things.  Effectiveness  tends  to  deal  with  People. 

We  manage  things,  we  lead  people. 

— Unknown 

Research  Origins 

This  research  paper  was  born  out  of  my  interest  of  how  ideas  and  social  values  are 
transferred,  processed,  internalized,  and  acted  on  in  terms  of  behavior.  I  was  also  curious  if 
technology  was  being  used  effectively  to  meet  social  policy  objectives.  Specifically,  my 
research  targets  social  policy  training  as  provided  by  the  Air  Force’s  online  training  system,  the 
Advanced  Distributed  Learning  Service  (ADLS).  As  an  Air  Force  communications  officer  and 
previous  squadron  commander,  I  have  had  first-hand  experience  with  leveraging  technology, 
organizational  command  and  control,  and  balancing  mission  and  individual  needs.  I  know  there 
is  a  strong  lure  to  use  technology  to  gain  efficiencies  and  productivity  and  do  more  with  less  at  a 
faster  rate.  The  Air  Force  is  using  ADLS  to  do  this.  But  are  we  being  efficient  without  being 
effective?  Is  this  technology  empowered  acceleration  serving  the  purposes  of  spreading  and 
strengthening  social  policy  messages  and  values?  Or  are  the  messages  getting  lost  in  the  shuffle? 
Does  the  Air  Force  need  to  approach  learning  about  human  interactions  differently?  How?  This 
research  looks  to  assess  the  capabilities  and  implementation  of  ADLS  training  with  regard  to 
social  policy  training  goals  (desired  efficiency  and  effectiveness). 
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Research  Questions,  Methodology,  and  Assumptions 


My  overarching  research  question  is:  “/s  ADLS  efficient  and  effective  with  regard  to 
Air  Force  social  policy  goals?"  Associated  nested  and  follow-on  research  questions  are 
described  in  Table  1: 


Table  1:  ADLS  Social  Policy  Learning  Research  Vectors 


Question 

Description  of  Research  Effort 

'"What  social  policy  training  and  education 
is  being  provided  on  ADLS?" 

The  existing  state  of  ADLS  social  policy 
training  and  education  is  captured. 

"'What  are  general  Air  Force  ADLS  social 
policy  goals  with  regard  to 
training  and  education?" 

Air  Eorce  ADLS  social  policy  participants, 
motivations,  objectives,  and  views  of 
success  are  explored. 

"What  are  social  policy  learning 
challenges?" 

Challenges  for  Air  Eorce  desired  learning 
ends,  ways,  and  means  are  identified. 

"How  can  social  policy  learning 
be  considered?" 

Paradigms  of  social  policy  training  are 
proposed. 

"How  can  social  policy  learning 
be  evaluated?" 

The  measurement  of  efficiency  and 
effectiveness  with  regard  to  ADLS  social 
policy  learning  is  analyzed. 

"What  are  best  ways  to  address  ADLS 
social  policy  learning?" 

Best  practitioner  approaches  to  Air  Eorce 
social  policy  learning  challenges  and 
recommendations  are  presented. 

Research  Boundaries 

ADLS  social  policy  data  was  collected  via  various  archival  sources,  scholarly  work, 
government  documents,  online  public  record,  and  interviews.  This  research  focused  on  the 
ADLS  site  (https://golearn.csd.disa.mil/kc/login/login.asp)  and  the  Education  and  Training 
Course  Announcement  (ETCA)  site  (https://etca.randolph.afmil/)  as  of  the  cutoff  date 
21  January  2009.  Changes  to  these  sites  after  this  date  were  not  considered.  Course  content 
provided  on  ADES  was  considered  “training”  for  the  purposes  of  this  research;  no  attempt  to 
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delineate  online  “training”  from  “edueation”  was  made.  In  addition,  sinee  this  researeh  was  a 
holistie  analysis,  it  focused  on  assessment  breadth  as  opposed  to  depth.  Assessment  of  ADLS 
multimedia  content  was  performed  on  an  aggregate  not  an  individual  basis.  Sister  service  and 
future  Air  Force  web-based  training  and  education  efforts  are  noted,  but  not  fully  explored  as 
subject  under  study. 

Research  Relevance 

So,  why  should  you  care  about  this  research? 

First  of  all.  Air  Force  social  policies  are  important.  They  reflect  organizational  standards 
of  conduct,  core  values,  and  service  identity.  In  addition,  controversial  social  policy  issues 
continue  to  be  a  hot  button  for  DoD  organizations,  leadership,  and  policy  makers.  Social  policies 
steer  individual  and  organizational  understandings,  culture,  and  behaviors.  Highly  damaging 
institutional  and  personal  embarrassment  and  scandal  can  follow  from  misunderstanding  and 
mismanagement  of  social  policies.  In  short,  how  social  issues  are  trained  and  learned  is  very 
important.  Valid  assessment  of  training  effectiveness  and  efficiency  from  organizational  and 
learner  perspectives  is  crucial. 

Second,  it  appears  that  ADLS  social  policy  learning,  organizational  implementation,  and 
learner  value  is  out  of  balance.  There  seems  to  be  tension  between  an  organizational  emphasis 
for  efficiency  in  training  that  is  faster  to  complete  and  the  slower  development  of  educational 
relationships,  trust,  and  exposure  needed  for  personnel  to  internalize  social  policy  messages  as 
valuable  and  useful.  That  is,  a  member  may  not  be  motivated  or  able  to  internalize  social  policy 
information  and  values  to  truly  change  their  behavior  when  only  presented  material  once  a  year 
for  less  than  30  minutes  from  an  online  learning  site.  Air  Force  expectations  of  ADLS  training 
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effectiveness  for  modifying  personnel  awareness  and  behavior  regarding  social  policy  issues 
should  reflect  this. 

Finally,  research  has  been  requested  in  this  area.  A  2008  Air  Education  and  Training 
Command  (AETC)  whitepaper  recommended  further  investigations  on  training  and  learning 
concepts: 

“Conduct  fast  track  studies  and  reports  done  by  Air  War  College,  Air  Command  and  Staff 
College,  the  Air  Force  Institute  of  Technology,  and  other  organizations  and  individuals  to  further 
refine  and  explore  these  concepts  and  associated  capability  requirements.  Of  primary  importance 
are  studies  that  focus  on  the  proper  application  of  a  spectrum  of  media  to  enhance  learning  and 
appropriate  use  of  live,  virtual,  and  constructive  environments.”* 

Successful  implementation  of  social  policy  learning  is  in  the  Air  Eorce’s  best  interests. 
There  is  an  apparent  need  and  documented  desire  for  research  regarding  ADES  training, 
education,  learning  and  the  learner,  effectiveness,  and  efficiency.  Research  in  these  areas 
appears  to  be  relevant. 
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Background 


To  better  understand  the  nature  of  organizational  and  individual  relationships  involved 
with  soeial  poliey  training  via  ADLS,  a  brief  review  is  warranted.  This  baekground  will  set  the 
stage  for  later  analysis  of  ADLS  effieieney  and  effeetiveness  as  a  soeial  poliey  learning  tool. 


Synopsis  of  E-Learning  for  DoD 

Sinee  the  advent  of  the  eomputer  revolution  and  the  World  Wide  Web  in  the  1980’s, 
Ameriean  soeiety  has  attempted  to  harness  the  power  of  eleetronie  media  to  beeome  more 
effeetive  and  effieient.  Organizations  have  found  that  eleetronie  training  and  edueation 
aeeomplished  by  individuals  over  the  web  ean  provide  powerful  tools.  Benefits  inelude  quiek 
development,  wide  dissemination,  and  lower  eosts  allowing  a  larger  user  base  than  elassroom 
settings. 

The  Department  of  Defense  (DoD)  also  wanted  to  eapitalize  on  the  benefits  of 

information  teehnology.  At  the  end  of  the  1990’s,  the  DoD  began  to  fully  embraee  a  military 

strategy  to  “use  learning  and  information  teehnologies  to  modernize  edueation  and  training.” 

DoD  goals  were  speeified  to  use  teehnology  to  deliver  effieient  and  effeetive  results: 

“In  short,  the  strategy  is  to:  pursue  emerging  network-based  technologies;  create  common 
standards  that  will  enable  reuse  and  interoperability  of  learning  content;  lower  development 
costs;  promote  widespread  collaboration  that  can  satisfy  common  needs;  enhance  performance 
with  next-generation  learning  technologies;  work  closely  with  industry  to  influence  the  COTS 
product  development  cycle;  and  establish  a  coordinated  implementation  process.  It  is  designed  to 
deliver  efficient  and  effective  high-quality  learning  continuously  to  Department  of  Defense 
personnel  anytime  anywhere.  As  shown  [in  figure]  implementation  will  yield  the  desired  end- 
state,  the  DoD  Advanced  Distributed  Learning  System  (ADLS).” 

Figure  1  shows  the  DoD  plan  to  transition  to  advanced  distributed  learning. 
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Figure  1:  The  DoD  Advanced  Distributed  Learning  System  Continuum/ Architecture 

(Reprinted  from  DoD  Strategic  Plan  for  Advanced  Distributed  Learning,  Washington,  DC: 

Under  Secretary  of  Defense  for  Readiness  and  Training,  10.) 

In  addition  to  visions  of  improved  learning  eapabilities  and  technologieal  effieieneies,  the 
DoD  was  given  a  presidential  mandate  to  develop  federal  interoperable,  reusable  distanee 
learning  software  standards."^  In  the  last  decade,  the  military’s  modernization  efforts  toward 
leveraging  technology  in  training  and  education  have  shown  powerful  efficiencies  and  a  rapid 
increase  in  online  advanced  distributed  learning. 

Progression  of  Advanced  Distributed  Learning  Service  (ADLS) 

Since  January  2000,  the  Air  Force  has  greatly  expanded  its  web-based  online  learning 
through  the  use  of  ADLS.^  Operationally,  the  ADLS  program  currently  has  over  850,000 
registered  users  with  over  900  courses  online  or  in  production.  More  than  eight  million  courses 
have  been  completed  since  ADLS  went  live.  Over  half  of  those  were  completed  in  2008  alone. 
Operational  usage  has  been  consistent  and  climbing  (as  shown  in  Figure  2).  Despite  this 
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explosive  growth,  ADLS  is  touted  as  “ready  and  able  to  meet  current  and  future  capacity 
needs.”*’ 


ADLS  Weekly  Course  Completions 

50,000 

A”'*  O®''  ^  S®'  V®'  J.'*' S®''  S®'' A®*  A®*  O®'"  O®'"  S®'' 

-P  2008  2009 

Figure  2:  ADLS  Weekly  Course  Completions 

(Reprinted  from  “Advanced  Distributed  Learning  Service. ..into  the  Future”  brief  given  at  AETC  Symposium, 

15-16  Jan  2009,  slide  9.) 

Air  Force  training  using  ADLS  is  decentralized  in  both  course  creation  and  execution. 
The  ADLS  program  office  hosts,  but  does  not  create  course  content.  ADLS  training  and 
education  material  is  decentralized  to  Air  Force  functional  managers  who  create  and  manage 
what  is  taught  and  how  it  is  presented.  The  ADLS  program  office  acts  as  a  clearing  house  and 
distribution  point  for  developed  training  courses.  ADLS  provides  online  training  delivery  in  the 
following  areas:  Type  6  Tech  Training,  AF  Ancillary,  Deployment  Readiness,  Language  and 
Culture,  CDCs  [Career  Development  Course],  PME  [Professional  Military  Education],  and 
Eunctional  Specific.^  ADLS  also  provides  online  access,  situational  awareness,  and  training 
tracking  for  AE  personnel  and  leadership.  Mandatory  training  requirements  are  levied  on  Air 

Eorce  personnel  who  have  a  personalized  ADLS  transcript  that  details  their  training,  status 
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(current  or  non-current),  and  completion  history  (when  last  completed).  Management  of 
personnel  training  is  delegated  to  commanders  and  training  managers  at  unit  level  who  track 
their  personnel  and,  if  necessary,  provide  positive  encouragement/negative  consequences  to 
ensure  training  completion. 

Social  Policy  Content  on  ADLS 

What  is  social  policy?  A  simplistic  explanation  is  policy  dealing  with  human 
interactions.  My  research  found  no  well-established  definition  for  “social  policy”  but  has 

o 

adapted  one  from  online  sources: 

SOCIAL  “Relating  to  vision  or  direction  for  the  changing,  maintaining,  or  creating  social, 
POLICY:  working,  or  living  conditions  to  promote  better  human  welfare. 

Social  policy  is  public  policy  dealing  with  social  issues.” 

In  recent  years,  ADLS  has  been  used  to  provide  web-based  development  regarding  a 

number  of  DoD  social  policy  issues  such  as  equal  opportunity,  DoD  homosexual  policy,  the  No 

FEAR  Act,  human  persons  trafficking,  suicide  awareness,  and  violence  prevention.  As  of  21 

Jan  2009,  this  research  identified  14  ADLS  training  and  course  offerings  that  were  considered 

related  to  social  policy.  These  courses  fell  into  four  ADLS  description  categories. 

Eight  courses  were  categorized  as  DEOMI  (standing  for  Defense  Equal  Opportunity 

Management  Institute):  Communication  Skills,  Conflict  Management,  Cross-Cultural 

Communication,  Effective  Eeedback,  Ethical  Decision-making,  Group  Development  Theory, 

Perceptions,  and  Socialization. 

Three  courses  were  categorized  as  Miscellaneous:  Annual  Ethics  Training  for  OGE 
450/SE  278  Eilers,  Law  of  Armed  Conflict,  and  the  No  LEAR  (Notification  and  Eederal 
Employee  Anti-discrimination  and  Retaliation)  Act  Training. 
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One  course  was  categorized  as  Total  Force  Awareness  Training.  Human  Relations  is  a 
combination  of  three  courses  previously  offered  as  Combating  Trafficking  in  Persons,  Suicide 
Awareness,  and  Violence  Prevention. 

Two  courses  were  categorized  as  All  Courses  and  were  not  offered  under  any  individual 
ADLS  category:  Homosexual  Policy  Training  for  CCs,  JAs,  and  SF  Personnel  and  Homosexual 
Policy  for  Managers.  (Note  for  non-military  readers:  CCs  =  Commanders;  JA  =  Judge 
Advocate;  SF  =  Security  Force). 

ADLS  social  policy  course  offerings  are  described  in  Figure  3. 


Figure  3:  ADLS  Social  Policy  Course  Offering  by  ADLS  Categories 

ADLS  courses  regarding  social  policy  material,  those  dealing  with  social  issues  or  human 
interactions,  will  serve  as  the  research  data  to  be  examined  and  analyzed.  By  examining  the 


9 


ADLS  course  material  in  eontext  with  Air  Foree  organizational  and  learning  objeetives,  an 
assessment  of  ADLS  effieiency  and  effeetiveness  ean  be  made. 

Learning  as  Related  to  Social  Policy 

Sinee  ADLS  is  used  to  provide  training  on  soeial  poliey,  it  is  appropriate  to  review  some 
related  learning  theory.  Later  researeh  analysis  assessing  ADLS  with  regard  to  Air  Foree  soeial 
poliey  purposes  will  use  this  learning  theory  to  ground  assessments,  judgments,  and  eonelusions. 
As  sueh,  baekground  is  provided  on  eognitive  and  affeetive  learning,  organizational  eulture 
impaet  to  learning,  and  multimedia  learning  theory. 

Domains  of  Learning 

Studies  by  psyehologists  done  in  the  1950s  and  later  updated  in  the  1990s  elassified 
different  types  and  levels  of  learning.  The  best  known.  Bloom’s  Taxonomy,  asserts  that  there  are 
three  overlapping  domains  of  learning:  eognitive,  dealing  with  the  proeessing  of  knowledge; 
affective,  involving  the  proeessing  of  values,  emotions,  attitudes,  or  motivation;  and 
psyehomotor,  involving  learning  motor  skills.^  Eaeh  domain  of  learning  has  a  hierarchy  of 
development.  While  cognitive  studies  have  reeeived  most  of  the  attention  and  applieation  in 
learning  venues,  it  is  important  to  note  that  learning  about  soeial  issues  and  human  interaetion 
involves  both  eognitive  and  affeetive  proeessing.  On  a  personal  level,  soeial  policy  training 
involves  information  transfer  leading  to  knowledge,  but  also  pereeption,  motivation,  feelings, 
and  incorporation  of  values.  While  affeetive  proeessing  is  not  understood  as  well  as  cognitive 
proeessing,^*’  emotional  response  is  eonsidered  a  key  to  “messages  that  stiek.”*’  It  is  important 
that  evaluation  of  training  of  soeial  poliey  assess  suecess  in  both  types  of  learning.  Figures  4  and 
5  illustrate  learning  hierarehies  for  the  eognitive  and  affeetive  domains. 
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Characterizing 


Figure  4:  Taxonomy  of  Cognitive  Domain 

(Adapted  from  Anderson  &  Krathwohl,  A  Taxonomy 
for  Learning,  Teaching  and  Assessing:  A  Revision  of 
Bloom 's  Taxonomy  of  Educational  Objectives. 

New  York,  NY:  Longman,  2001) 


Figure  5:  Taxonomy  of  Affective  Domain 

(Adapted  from  Krathwohl,  Bloom,  &  Masia,  Taxonomy 
of  Educational  Objectives:  The  Classification  of 
Educational  Goals  -  Handbook  II:  Affective  Domain. 
New  York,  NY:  David  McKay,  1964) 


Organizational  Culture  Impact  to  Learning 

Social  policy  training  effectiveness  is  greatly  impacted  by  organizational  eulture  in  how 
the  training  is  pereeived  (valued  or  not)  and  exeeuted  (treated  in  terms  of  attention  and 
resourees).  In  the  last  twenty  years,  the  eoneept  of  organizational  eulture  has  gained  aeeeptanee 
as  a  way  of  understanding  human  interaetions  and  behavior  from  a  systems  perspeetive.  Edgar 
Sehein,  a  respeeted  organizational  eulture  theorist,  noted,  “Culture  is  an  abstraetion,  yet  the 

forees  that  are  ereated  in  soeial  and  organizational  situations  that  derive  from  eulture  are 

12 

powerful.  If  we  don’t  understand  the  operation  of  these  forees,  we  become  vietim  to  them.” 
He  holds  that  behavior  in  organizations  ean  be  tied  to  underlying  values  and  shared  assumptions 
of  members,  whieh  are  often  uneonseious  and  unstated.  What  top  leaders  pay  attention  to, 
reward,  and  measure  ultimately  has  great  impaet  on  organizational  member  aetivity  and 
behavior.  Sehein  posits  that  leadership  and  eulture  are  “two  sides  of  the  same  eoin”  and  that 
one  of  the  most  deeisive  funetions  of  leadership  is  in  the  ereation,  management,  and  if  neeessary, 
destruetion  of  cultures  in  organizations. 
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Multimedia  Learning 

ADLS  uses  multimedia  to  provide  training  on  social  policies.  Multimedia  has  been 
defined  as  “the  combination  of  various  media  types,  such  as  text,  images,  sound,  and  video,  into 
an  integrated  multisensory  interactive  application  or  presentation  to  convey  a  message  or 
information  to  an  audience. Research  has  shown  types  and  methods  of  media  presentation 
such  as  text,  graphics,  and  sound  can  greatly  affect  learning  according  to  a  targeted  audience. 
Also,  a  learner’s  ability  to  interact  within  their  online  environment,  control  their  own  learning, 
and  provide  feedback  all  add  to  a  positive  learning  experience. See  Figures  6  and  7. 


Process  Transfer 

(Reprinted  from  Patti  Shank,  “The  Value  of  Multimedia  in  Learning,”  website  from  Adobe  Design  Center, 
http://www.adobe.com/designcenter/thinktank/valuemedia/The_Value_of_Multimedia.pdf) 

In  the  end,  effectiveness  in  multimedia  learning  does  not  consist  of  using  multiple  media 
together,  but  “combining  media  mindfully  in  ways  that  capitalize  on  the  characteristics  of  each 
individual  media  and  extend  and  augment  the  learning  experience.”'^ 
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Analysis 


We  shape  our  tools  and  afterwards  our  tools  shape  us. 

—  Marshall  McLuhan 

Not  everything  that  counts  can  be  counted,  and  not  everything  that  can  be  counted  counts. 

—  Albert  Einstein 

The  following  analysis  assesses  the  efficiency  and  effectiveness  of  ADLS  in  light  of 
social  policy  participants,  their  objectives,  and  measures  of  success.  A  simplistic  assessment  of 
ADLS  is  difficult  because  success  is  relative.  Social  policy  makers,  the  Air  Force  organization, 
the  ADLS  mechanism,  and  learners  have  different  measures  of  success.  They  interact  in  various 
ways  within  their  technology,  operational,  cultural,  and  fiscal  environments  and  constraints. 
Figure  8  shows  that  what  is  considered  ADLS  success,  in  terms  of  effectiveness  and  efficiency, 
may  differ  substantially  based  on  perspective  and  goals  of  the  participant. 


ADLS  Training  &  Education  (Learning  Media  &  ADLS  Mechanism) 

Train  &  Educate  the  Social  Policy  -  "Anytime,  Anywhere" 
Make  Social  Policy  available  via  ADLS  * 


CULTURAL 

IVIRONMENT 


Learn  tl 
Internalizt 
Live  out 


OPERATIONAL  ^  ^ 

ENVIRONMENT  Social  Policy  Maker 


FISCAL 

ENVIRONMENT 


^  AF  Organization 

Adopt  the  Social  Policy 
Promote  the  Social  Policy 
Track  the  Social  Policy 
Enforce  the  Social  Policy 


Create  the  Social  Policy 
Provides  authority  for  Social  Policy 
Specifies  vision  for  Social  Policy 


Figure  8;  Perspectives  of  ADLS  Social  Policy  Success 
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State  of  Social  Policy  Training  on  ADLS 

This  research  attempted  to  discern  social  policy  maker  goals  and  requirements  for  the  14 
ADLS  course  offerings  that  were  associated  with  Air  Force  social  policy.  Additionally,  each  of 
the  offerings  was  judged  by  the  researcher  to  be  effective  or  not  in  meeting  the  policy  maker 
letter  of  the  law  requirements  or  mandates  with  regards  to  training.  To  do  this,  original  social 
policy  directives  were  researched  to  determine  policy  maker  training  standards  and  parameters 
(i.e.,  what  kind  of  training  was  required,  how  often  training  is  needed,  competence  required). 
Summary  analysis  tables  of  ADLS  social  policy  training  participants,  content,  goals, 
requirements,  and  effectiveness  assessment  are  found  in  Appendix  A.  My  finding  is  that  while 
policy  authority  mandates  are  being  met,  Air  Force  training  on  social  policy  in  its  current 
state  is  being  hampered  by  overemphasis  on  efficient  output  based  on  training  completion  over 
effective  outcomes  based  on  competence  or  results.  Other  problems  include  disorganized 
presentation  and  deficiencies  in  strategic  leadership,  organizational  culture  barriers,  and  an 
overriding  focus  on  technology.  A  new  focus  by  AETC  and  ADLS  on  learning  and  the  learner 
may  address  some  of  these  shortfalls. 

Overemphasis  on  Efficient  Output  over  Effective  Outcomes 

Policy  makers  differ  for  the  various  social  issues  currently  trained  on  ADLS,  but  include 
high  national  authorities  including  the  President,  Congress,  and  the  Secretary  of  Defense.  After 
examination  of  all  the  social  policy  mandates  found  within  ADLS  training  directives,  it  is  very 
apparent  that  social  policy  makers  have  given  the  Armed  Forces,  and  in  this  case  the  Air  Force, 
wide  latitude  in  how  training  is  presented  and  measured.  That  military  services  are  responsible 
for  their  own  training  is  appropriate  per  military  doctrine.  However,  the  only  consistent  strict 
requirement  for  social  policy  training  is  that  it  be  performed  at  specified  intervals.  Social  policy 
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training  mandates  had  little  to  no  requirements  for  any  form  of  demonstrated  competence  or 
learning  by  the  trainee.  The  most  stringent  requirement  came  from  a  Law  of  Armed  Conflict 
training  call  for  “instruction  to  the  point  of  familiarity  for  all  ranks  and  positions. Only  2  of  14 
training  courses  (Law  of  Armed  Conflict  and  No  FEAR  Act  training)  required  any  kind  of 
competency  test  for  successful  completion.  But  even  these  courses  required  only  a  70%  pass  rate 
and  there  was  no  penalty  for  rapid/numerous  test  retakes.  This  strong  emphasis  on  social  policy 
training  frequency  and  completion  over  trainee  competence  seems  to  create  an  unintended 
consequence.  Organizational  focus  is  on  tracking  completed  training  rather  than  ensuring 
personnel  learn  social  policy  material.  Organizational  efficient  output,  Air  Force  members  that 
have  completed  training  on  a  recurring  basis,  is  trumping  effective  outcomes.  Air  Force  members 
that  are  competent  on  social  policy  issues. 

This  current  emphasis  on  efficient  output  over  effective  outcomes  is  shown  through  what 
the  Air  Force  measures  as  standards  of  success  or  effectiveness.  The  adage  “you  measure  what 
you  care  about”  applies  here.  The  Air  Force  as  a  military  service  is  liable  to  various  social 
policy  authorities  for  meeting  their  required  frequency  mandates  for  completed  training.  As  a 
result,  tracking  and  documentable  evidence  of  training  completion  is  a  priority  for  the  Air 
Force — so  a  true  statement  can  be  made:  “Air  Force  personnel  are  fully  trained  on  [specific 
social  policy].”  ADLS  performs  this  role  nicely  extending  online  training  across  the  Air  Force, 
tracking  individual  training  deadlines,  and  documenting  training  completion.  Currently,  social 
policy  training  collects  completion  data,  which  is  easy  to  measure.  From  personal  experience,  at 
the  squadron  level,  unit  social  policy  training  completion  metrics  are  normally  captured  under 
ancillary  training  completion  rate  statistics.  Since  squadron  commanders  and  individual 
members  face  possible  negative  attention,  consequences,  and  discipline  if  ancillary  training  rates 
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documenting  completion  is  low,  there  is  strong  motivation  to  complete  training  within  set 
deadlines.  This  organizational  deeentralized  drive  to  ensure  training  completion  output  has  been 
called  “chasing  the  green”  referring  to  the  green  color  usually  associated  with  positive  metrics. 
In  the  end,  the  apparent  foeus  on  soeial  poliey  training  eompletion  is  understandable  in  terms  of 
Air  Force  need  to  meet  policy  maker  mandates,  ease  of  organizational  measurement,  and 
unit/individual  desire  for  positive  metrics. 

Besides  completion,  what  else  would  provide  measures  of  value  for  assessing  training  on 
Air  Force  soeial  poliey  issues?  Soeial  poliey  training  ean  be  measured  in  two  domains  from 
Bloom’s  Taxonomy:  eognitive  and  affective  learning.  To  be  sure,  measures  of  cognitive 
learning  should  gauge  eompetenee  of  a  learner’s  understanding  of  soeial  poliey  eoncepts  and 
terminology  providing  eommon  language  and  frames  of  reference  for  real  world  situations. 
Measurement  of  affeetive  learning  is  a  harder  target;  motivation,  awareness,  interest,  and 
emotional  measures  are  notably  problematie  due  to  their  personal  nature.  Traditional  methods  of 
measuring  an  affeetive  experienee  can  be  made  unreliable  by  a  member’s  “awareness  of  internal 
state,  refleetions  on  how  such  a  report  will  be  pereeived,  ability  to  articulate  what  one  feels,  and 
more.”  However,  maybe  even  a  small  level  of  affeetive  feedbaek  would  allow  learners  an 
amount  of  control  and  course  designers  better  insight  into  ways  to  improve  future  training 
experienees.  At  this  time,  no  soeial  policy  training  provided  on  ADLS  has  any  way  of  providing 
feedbaek.  In  any  case,  eognitive  and  affective  measures  should  promote  Air  Force  soeial  policy 
training  that  is  focused  on  effeetive  outeomes.  Trainees  should  be  provided  the  best  possible 
training  to  ensure  social  policy  “street  smarts”  not  just  “book  smarts”  for  successful  human 
interactions  in  the  real  world. 
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Also,  ADLS  social  policy  training  measurements  of  eompletion  are  not  tied  to  real  life 
outcomes  or  effeets  at  individual  or  aggregate  Air  Foree  levels.  That  is,  at  present,  this 
researeher  found  no  evidenee  of  any  Air  Force  attempt  to  evaluate  ADLS  soeial  poliey  training 
impaets  on  Air  Foree  soeial  phenomena  (e.g.,  suieide  rates,  ineidents  of  violence,  oeeurrenees  of 
social  misbehavior,  cases  of  diserimination).  Whether  this  absence  of  an  ADLS  social  policy 
training  cause/effect  assessment  is  due  to  a  laek  of  data  or  a  desire  to  avoid  a  spotlight  on 
negative  Air  Foree  soeial  measures  is  unclear.  However,  social  policy  makers  want  suecessful 
human  interaetion  in  the  real  world.  It  is  the  reason  for  ADLS  soeial  policy  training 
requirements.  In  this  regard,  achieving  efficiency  in  training  without  positive  Air  Force  soeial 
policy  results  in  the  real  world  is  pointless  and,  in  fact,  wasteful. 

Disorganized  Presentation  and  Deficiencies  in  Strategic  Leadership 

Learning  is  hampered  by  how  Air  Foree  ADLS  soeial  policy  training  is  presented, 
organized,  and  exeeuted.  Also,  a  laek  of  strategie  leadership  foeus  appears  to  negleet  or 
marginalize  Air  Foree  social  policy  messages  provided  on  ADLS. 

First  of  all,  the  14  soeial  poliey  training  courses  provided  by  ADLS  are  seattered  in  a 
piecemeal  fashion  under  three  different  non-descript  categories  (DEOMI,  Miscellaneous,  and 
Total  Foree  Awareness)  or,  in  the  ease  of  homosexual  poliey  training,  only  found  in  a  seareh 
under  the  All  Courses  listing.  In  short,  social  policy  training  on  ADLS  is  not  strategically 
presented  and  is  hard  to  find  unless  one  knows  where  to  look.  Besides  obseuring  soeial  poliey 
training  loeations,  category  descriptions  are  deficient.  The  descriptions,  DEOMI,  an  obscure 
aeronym,  and  Miscellaneous,  referring  to  generie  leftovers,  risk  marginalizing  soeial  poliey 
content  messages  as  unimportant.  Words  matter.  An  ADES  “Soeial  Policy”  category  would 
elearly  and  collectively  identify  eontent. 
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Second,  ADLS  social  policy  training  language  can  be  overly  legalistic  and  controlling  at 
times.  While  regulation  references  are  occasionally  useful  in  providing  authority  sources,  the 
danger  of  presenting  social  policy  training  in  too  rule-based  a  fashion  is  that  training  can  be 
perceived  to  be  an  organizational  “gotcha”  mechanism.  That  is,  there  is  risk  that  ADLS  social 
policy  messages  may  not  be  seen  as  important  learning  opportunities  or  reinforcement  of  key 
information,  but  rather  as  a  form  of  Air  Force  behavior  control.  Language  should  be  carefully 
tailored  and  presented  in  a  manner  to  best  promote  learning,  positive  relationships,  and  Air  Force 
socialization.  Messages  should  inspire  positive  actions  as  well  as  prohibit  negative  conduct. 

Lastly,  in  terms  of  organization  and  execution,  the  Air  Force’s  ADLS  social  policy 
training  efforts  resemble  an  assembly  line  managing  a  series  of  tasks  rather  than  our  leadership 
priorities  focused  on  shaping  and  sustaining  individual  core  values  and  transforming 
organizational  cultures.  The  training  process  is  highly  delegated,  distributed,  and  decentralized. 
Social  issues  are  farmed  out  to  various  offices  of  primary  responsibility  (OPRs).  These 
functional  managers  provide  course  content  to  the  ADLS  program  office  which  acts  as  a  digital 
clearing  house  for  distribution  and  tracking.  Self-service  online  training  backed  up  by  unit 
training  apparatus  and  commander  oversight  provides  a  highly  decentralized  execution 
mechanism.  As  long  as  personnel  complete  online  training  at  regular  intervals,  no  human 
contact  of  any  kind  is  required.  This  separation  of  effort  approach  to  managing  ADLS  social 
policy  training  is  highly  efficient  with  faster  production,  less  oversight,  and  self  sustainment,  but 
unintentionally  demonstrates  a  lack  of  leadership  focus  and  priority  for  social  policy  messages. 

This  lack  of  strategic  leadership  focus  for  ADLS  social  policy  training  is  demonstrated  in 
a  number  of  ways.  First  of  all.  Air  Force  social  policy  training  content  and  presentations  differ 
greatly  in  training  approach,  look,  and  feel  due  to  various  OPRs;  there  is  no  one  social  czar 
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standardizing  policy  messages  or  learning  format.  Training  organizations  are  hierarchical  with 
strategic  content,  operational  distribution,  and  tactical  execution  levels  that  are  segmented  and  do 
not  typically  interact  or  provide  feedback  in  a  training  transaction.  This  is  not  like  a  chain  of 
command  with  two-way  communication.  And,  as  stated  previously,  the  eurrent  organizational 
focus  on  measures  of  completion  rather  than  competence  is  indicative  of  a  management  rather 
than  leadership  process. 

It  is  important  to  realize  that  social  policies  reflect  our  Air  Force  core  values  and,  as  such, 
must  be  led,  not  just  managed.  Social  policy  that  is  only  managed  marginalizes  the  importance 
of  the  message.  Social  policies,  just  like  our  Air  Force  core  values,  serve  as  a  source  of  identity 
and  worth  as  well  as  providing  guidance  for  organizational  and  individual  standards  of  conduct. 
They  reflect  “who  we  are”  and  “what  we  do.”  Social  policies  dealing  with  integrity,  trust, 
cooperation,  unity,  professionalism,  and  cohesion  buttress  the  social  fabric  of  Air  Force 
organizations  and  human  interactions.  As  such,  they  are  critical  mission  enablers  for  the  Air 
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Force  to  "'fly, fight,  and  win... in  air,  space,  and  cyberspace.” 

Clearly,  the  Air  Force  does  care  about  social  policy  and  human  interactions.  Existing  Air 
Force  strategie  planning  and  leadership  messages  capture  the  importanee  and  need  to  “develop 
and  care  for  Airmen  and  their  families.”  The  chain  of  command  is  fully  functional. 
Development  of  leaders  and  followers,  mentorship,  chaplain  outreach  to  personnel,  inspector 
general  investigations  and  reporting,  active  Military  Equal  Opportunity  (MEO)  programs,  and 
ereation  of  24/7  on-call  Sexual  Assault  Response  Coordinators  (SARCs)  all  demonstrate  daily 
eommitment  to  Air  Eorce  personnel  and  operate  according  to  supporting  organizational 
structures.  However,  the  current  decentralized  ADES  mechanism  for  providing  homogenous 
training  on  service  level  social  issues  does  not  address  the  proactive  leadership  required  to 
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positively  influence  and  change  organizational  culture  and  individual  behavior.  Instead,  local 
leadership  is  entrusted  with  handling  and  reacting  to  issues  as  they  occur. 

Organizational  Culture  Barriers 

Organizational  culture  barriers,  whether  consciously  applied  or  not,  can  negatively 

impact  ADLS  social  policy  training  effectiveness.  Most  barriers  develop  over  time  as 

unintended  consequences  of  existing  reward/punishment  practices,  established  norms  of 

operations  and  measurement,  and  unspoken  value  systems.  Some  perceived  examples  of 

organizational  culture  barriers  to  ADLS  social  policy  training  include:  1)  “chasing  the  green”,  a 
focus  on  organization  metrics  rather  than  individual  learning;  2)  expectations  to  complete 
training  “on  your  own  time”,  not  “recognizing  that  learning  is  an  official  requirement  of  the  duty 
day”  ;  3)  disdain  for  non-job  training,  not  recognizing  the  value  of  social  policy  training;  and 
4)  treating  social  policy  training  like  a  task,  not  a  process  of  learning  important  knowledge  and 
incorporating  values.  Leadership  is  needed  to  change  organizational  culture  to  remove  barriers 
to  learning. 

Overriding  Focus  on  Technology 

25 

It  has  been  said  that  the  Air  Force  worships  at  the  altar  of  technology.  Obviously, 
information  technology  lends  powerful  efficiencies  to  online  training  like  ADLS.  However,  too 
much  information  technology  focus  can  be  counterproductive  because  it  monopolizes  too  much 
attention  on  the  power  of  the  mechanism  rather  than  the  message.  The  authors  of  The  Social 
Life  of  Information  agree.  They  say  that  infoenthusiasts  have  promoted  the  power  and  promise 
of  technology,  but  have  forgotten  the  important  contextual  roles  of  social  life,  human  networks, 
and  cultural  institutions.  They  contend  that  there  is  more  to  information  technology  advances 
than  processing  power  and  global  access: 
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“We  believe  that  all  the  hype  surrounding  the  eapabilities  of  information  teehnologies  have  led  us 
to  develop  a  dangerous  form  of  tunnel  vision  regarding  where  the  new  teehnologies  ean  take  us 
and  so  how  they  should  be  designed.  We’ve  beeome  so  foeused  on  driving  relentlessly  forward, 
that  we  have  pushed  aside  all  the  fuzzy  stuff  in  the  periphery — eontext,  baekground,  history, 
eommon  knowledge,  soeial  resourees — that  helps  frame  human  aetivities.  Though  vital  to  how  we 
all  live  and  work,  eonsideration  of  things  like  eommunities,  organizations,  and  institutions  are  too 
often  missing  from  the  design  stylebooks  of  the  information  age.” 

Seen  strietly  as  a  teehnology  platform,  delivery  meehanism,  or  tool  for  distributed 
learning,  ADLS  appears  to  work  as  designed.  ADLS  soeial  poliey  training  eourses  appeared 
effeetive  with  regard  to  multimedia  and  information  presentation.  Indeed,  course  multimedia 
content  was  much  more  dynamic  and  visually  stimulating  than  previously  observed  offerings, 
which  were  more  text  based.  ADLS,  still  in  a  fledgling  state,  is  quickly  becoming  more 
sophisticated.  However,  at  this  time,  from  a  human  factors  perspective,  there  are  still  major 
limitations.  Training  is  not  interactive.  This  is  a  major  deficiency  since  social  policy  is  based  on 
human  interactions,  and  isolated  training  can  quickly  become  mechanical.  Existing  ADLS 
technology  only  allows  trainees  to  control  their  learning  progress  in  one  direction  with  limited 
additional  accessible  resource  material.  No  means  of  feedback  are  provided  to  learners.  In  short, 
while  ADLS  technology  is  functional,  it  is  somewhat  dehumanizing;  improvements  are  needed 
to  allow  a  more  human  experience. 

Also,  there  is  evidence  to  suggest  a  strong  organizational  technology  bias  in  expectations 
of  ADLS  success  criteria  and  implementation.  Ligure  12  in  Appendix  B  illustrates  DoD 
technology-centric  end  state  criteria  for  advanced  distributed  learning  (ADL)  systems.  Ligure  13 
in  Appendix  B  illustrates  technology-centric  DoD  views  of  organizational  success  (i.e.,  service 
capabilities  for  a  successful  ADL  implementation).  Both  figures  demonstrate  measures  of 
success  that  are  couched  in  technological,  as  opposed  to  learning,  terms.  ADLS  end  states,  cost 
benefit  analysis,  assessment  of  progress,  and  associated  metrics  all  show  this  trend.  This 
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overriding  technology  focus  helps  explain  the  previously  described  Air  Force  tendency  towards 
resource  management  rather  than  treating  ADLS  social  policy  training  as  a  leadership  enterprise. 

Paradigms  of  Social  Policy  Training 

Two  paradigms  illustrate  extreme  approaches  to  social  policy  training  that  require 
balance  in  the  real  world  to  meet  organizational  and  individual  needs;  the  Social  Policy  Kill 
Chain  and  the  Learner  in  the  Loop. 

Social  Policy  Kill  Chain 

The  military  has  what  they  call  a  “kill  chain”  concept  of  “target  identification,  force 
dispatch  to  target,  decision  and  order  to  attack  the  target,  and  finally  the  destruction  of  the 
target.”  Beyond  the  effectiveness  of  a  target  “kill,”  having  a  fast  kill  chain  with  speed  of 
identification,  dispatch,  decision,  and  destruction  of  a  target  is  highly  efficient.  The  Social 
Policy  Kill  Chain  paradigm  parallels  this  cycle.  In  this  paradigm,  online  social  policy  training 
and  tracking  mechanisms  are  focused  solely  on  meeting  social  policy  maker  mandates,  the 
organizational  “target”  for  effectiveness.  The  main  effort  is  to  kill  the  target,  complete  the 
training,  track  it,  and  declare  personnel  a  “trained”  resource.  In  conjunction,  reducing  learner 
training  time  and  training  costs  to  gain  efficiency  is  encouraged.  Online  social  policy  training 
courses  incorporate  minimal  competence  or  comprehension  tests,  which  allows  very  rapid  web 
clicks  to  accelerate  training  completion.  All  tests  have  low  passing  standards  and  are  easy  to 
accomplish.  Organizational  management  and  control  mechanisms  ensure  personnel  complete 
their  training  on  time  every  time.  Individual  learning  and  socio-cultural  development  is  not 
discouraged,  but  much  more  organizational  focus  is  placed  on  achieving  desired  personnel 
behavior  through  standards  of  conduct  and  rule  enforcement. 
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Learner  in  the  Loop 

The  counterbalance  is  the  Learner  in  the  Loop  paradigm.  Within  this  paradigm,  the 
learner  is  supreme.  Organizations  spare  no  expense  in  providing  engaging,  personalized,  and 
interactive  training  resources.  Social  policy  intrinsic  values  are  promoted  and  learning  is 
stressed  as  part  of  professional  development.  Leaders  use  enabling  technology  to  create  positive 
learning  environments  and  to  simulate  real  world  scenarios.  Extensive  educational  resources  are 
made  available  for  additional  self-paced  personal  development  in  areas  of  interest  or  value  to 
learners. 

Clearly,  both  paradigms  are  extreme.  However,  at  this  time.  Air  Force  implementation  of 
ADLS  social  policy  training  appears  to  be  facilitating  more  of  a  social  policy  kill  chain  than 
promoting  social  policy  learning.  While  the  existing  bias  is  understood  in  light  of  environmental 
challenges  such  as  dealing  with  mandates,  ops  tempo,  constrained  resources,  etc.,  a  change  is 
required.  What  is  needed  is  a  better  balance  between  managing  organizational  resources  and 
leading  a  learning  enterprise. 

Way  Ahead  for  Air  Force  Learning 

The  Air  Force  is  already  in  the  process  of  addressing  some  of  the  needed  changes.  A 
2008  AETC  whitepaper  titled,  “On  Fearning:  The  Future  of  Air  Force  Education  and  Training,” 
provides  a  vision  of  the  need  for  a  learning  organization  culture: 

“To  achieve  cognitive  and  learning  superiority,  the  Air  Force  must  develop  a  new  learning 

organization  culture.  Learning  will  also  focus  on  the  affective  domain  by  developing  intellectual 

skills,  knowledge,  and  attitudes  that  embrace  the  Air  Force’s  warrior  ethos  and  core  values. 
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Knowledge  is  power  and  learning  is  the  means  to  put  this  knowledge  in  the  hands  of  Airmen.” 

Figures  3  and  4  illustrate  the  shift  toward  a  learner-centric  approach. 
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Figure  3:  Future  Learning  Figure  4:  Managing  Future  Learning 

(Reprinted  from  AETC  whitepaper,  On  Learning:  The  Future  of  Air  Force  Education  and  Training, 

30  January  2008,  10  and  17  respectively) 

Also  noted  was  the  need  to  transform  existing  Air  Force  learning  to  meet  tomorrow’s  challenges: 

“To  become  an  agile  organization  comfortable  with  continuous  improvement  and  change,  the 
greatest  hope  for  the  Air  Force  is  to  educate  and  train  Airmen  comfortable  with  continuous  and 
collaborative  learning.  The  skills  required  for  future  Airmen  to  succeed  necessitate  a 

9^29 

transformational  shift  from  education  and  training  to  a  focus  on  learning  and  the  learner  f 

This  new  AETC  and  ADLS  focus  on  the  learner  holds  the  potential  to  address  noted  social  policy 
training  shortfalls,  restore  balance  between  organizational  and  individual  requirements,  and 
counterweight  Social  Policy  Kill  Chain  and  Learner  in  the  Loop  approaches. 
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Conclusions 


This  research  addressed  the  research  question,  “/s  ADLS  efficient  and  effective  with 
regard  to  Air  Force  social  policy  goals?"  In  doing  so,  this  research  analyzed  the  different 
ADLS  social  policy  participants  (social  policy  makers,  ADLS  program  office,  the  Air  Force  as 
an  organization,  and  the  learner)  perspectives,  motivations,  objectives,  and  views  of  success. 
Measures  of  success  for  effectiveness  and  efficiency  were  determined  to  be  relative  to  the 
participant  role  and  ability  to  work  within  operational,  fiscal,  cultural,  and  technical 
environments  and  constraints.  Air  Force  ADLS  social  policy  training  offerings  were  identified, 
analyzed  and  found  to  meet  definitive  policy  maker  mandates.  But,  this  researcher  asserts  that  in 
its  current  state  Air  Force  training  and  thus  learning  on  social  issues  is  hampered  by 
overemphasis  on  efficient  output  based  on  training  completion  over  effective  outcomes  based  on 
competence  or  results.  Other  problems  include  disorganized  presentation  and  strategic 
leadership  deficiencies,  organizational  culture  barriers,  and  an  overriding  focus  on  technology. 
At  present,  the  Social  Policy  Kill  Chain  management  paradigm  is  winning  out  over  a  Learner  in 
the  Loop  leadership  and  promotion  of  growth.  However,  on  a  positive  note,  there  appears  to  be  a 
shift  by  AETC  and  the  ADLS  program  to  increase  focus  on  learning  and  the  learner.  Social 
policy  training  was  deemed  a  challenging  area  for  the  Air  Force  to  address  because  of  multiple 
learning  domains,  environmental  constraints,  and  necessity  of  balancing  organizational  and 
individual  learner  needs. 

Research  Contributions 

This  research  captured  the  existing  state  of  ADLS  social  policy  training  providing  a 
benchmark  for  future  improvements.  Policy  maker  mandates  and  training  requirements  were 
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investigated  with  regard  to  ADLS  training.  System  dynamie  descriptions  were  provided  for 
relationships  between  policy  makers,  the  Air  Force  organization,  ADLS  program  office  and 
technology  mechanism,  and  learners.  Counterproductive  activity  and  challenging  areas  of  ADLS 
social  policy  training  were  identified  for  improvement  in  light  of  meeting  and  balancing  both 
organizational  and  learner  needs. 

Recommendations 

My  first  recommendation  regards  terminology  for  social  policy  training  in  ADLS. 

Though  excessive  political  correctness  should  be  avoided,  words  matter.  ADLS  should  place  all 
social  policy  training  under  the  category  “Social  Policy.”  This  researcher  recommends  the 
removal  of  social  policy  training  from  Miscellaneous  and  All  Category  descriptions.  The 
continued  use  of  “ancillary”  which  is  defined  as  “subordinate;  subsidiary”  or  “non-job” 
terminology  of  social  policy  training  should  be  eliminated.  The  danger  is  that  Air  Force  social 
policy  training  will  be  perceived  as  unimportant  or  secondary.  In  doing  so,  the  intrinsic  value  of 
social  policy  messages  risks  being  marginalized.  The  bottom  line  is  that  social  policy  training  is 
important  to  the  Air  Force  and  should  be  promoted  as  such.  Air  Force  social  policy  training  is 
not  a  task  to  achieve,  it  is  an  Air  Force  mission  enabler.  Terminology  should  be  changed  to 
reflect  this  importance. 

This  researcher  recommends  more  measures  of  training  competence  for  ADLS  social 
policy  training.  Training  activity  without  measured  meaningful  results  is  self  defeating. 

Measures  should  capture  awareness,  understanding,  social  policy  value  assessment,  and  ability  to 
apply  social  policy  in  real  world  scenarios.  Expectations  of  required  competence  and  level  of 
mastery  for  social  policy  issues  should  be  related  to  Air  Force  personnel  rank  progression  and 
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responsibilities.  Fundamental  levels  of  eompetency  should  be  augmented  during  sehoolhouse  or 
online  professional  military  edueation  as  part  of  leadership  development. 

As  part  of  making  measurement  meaningful,  ADLS  social  policy  training  competence 
measures  should  be  compared  and  correlated  with  Air  Force  social  phenomena.  The  Air  Force 
should  attempt  to  connect  training  data  measures  of  social  policy  competence  to  personnel 
behavior.  Social  phenomena  rates  that  are  usually  couched  in  negative  events  like  suicide, 
violence,  and  theft  could  cast  a  shadow  on  positive  programs.  However,  meaningful  analysis  can 
provide  insight  into  value  of  training,  degrees  of  learning,  and  feedback  for  improvement  efforts. 

The  Air  Force  should  promote  ADLS  as  an  educational  resource  and  reference  site  for 
social  issues  and  leadership  development  and  not  just  as  a  source  of  training  tasks.  ADLS  should 
not  be  seen  as  just  a  required  training  website  but  a  portal  for  Air  Force  strategic  focus  on 
important  topics  regarding  personnel  wellness,  healthy  human  interactions,  family  support,  and 
overcoming  social  challenges. Ideally,  training  provided  could  be  synchronized  with  scheduled 
“Wingman”  days  for  local  leadership  involvement  and  emphasis.  Relevant  service  independent 
training  courses  on  leadership  and  professional  development  already  developed  on  the  Army’s 
Distributed  Learning  System  and  Navy  eLearning  should  be  sought  and  made  available. 

In  addition,  three  existing  concepts,  already  being  used  in  other  Air  Force  arenas,  are 
recommended  as  valuable  for  future  organizational  use  in  social  policy  learning  endeavors. 

The  first  concept  is  the  Balanced  Scorecard  approach  to  strategic  planning  and 
management  (shown  in  Figure  9).  The  Balanced  Scorecard  approach  promotes  a  measurement- 
based  system  for  implementing  strategic  vision  from  a  balanced  view  of  four  perspectives: 
learning  and  growth,  internal  business  processes,  customer,  and  financial  viewpoints.  Use  of 
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this  concept  in  the  area  of  ADLS  social  policy  content  development  and  execution  could  help 
balance  focus  for  all  ADLS  social  policy  stakeholders. 


Figure  9:  Balanced  Scorecard  Strategic  Planning  and  Management  System 

(Reprinted  from  Balaneed  Scoreeard  Institute,  adapted  from  Kaplan  &  Norton’s  The  Balanced  Scorecard, 
http://www.balaneedseoreeard.org/BSCRResourees/AbouttheBalaneedSeoreeard/tabid/55/Default.aspx) 


The  second  concept  is  the  Air  University’s  “Cross-Culturally  Competent  Airmen”  model 
that  is  currently  being  employed  by  the  Air  Force  Culture  and  Language  Center  to  develop 
foreign  culture  and  language  capabilities.  Cross-Cultural  Competence  is  described  as  “the  ability 
to  quickly  and  accurately  comprehend,  then  appropriately  and  effectively  act,  to  achieve  the 
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desired  effect  in  a  culturally  complex  environment.” 


Figure  10:  Cross-Cultural  Competence  Model 

(Reprinted  from  US  Air  Force  Culture  and  Language  Center  website,  http://www.culture.af  edu/) 
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Figure  10  depicts  an  individual  Airmen’s  ability  to  exert  influence  “over  mission  success 
and  institutional  health”  by  developing  “ability  to  negotiate,  build  relations  and  communicate 
across  cultural  differences.”^^  Currently,  this  effort  is  externally  focused  toward  practically 
preparing  Airmen  for  expeditionary  operations  in  foreign  countries.  However,  the  same 
principles  and  educational  structure  could  be  easily  adapted  for  an  internally  focused  integrated 
program  for  Air  Force  socio-cultural  development,  training,  and  education. 

The  third  concept  is  the  OODA  loop.^"^  Air  Force  Colonel  John  Boyd’s  OODA  (or 
Observe,  Orient,  Decide,  and  Act)  loop  has  long  been  used  to  model  the  decision  making  process 
and  is  applied  as  an  important  concept  in  military  strategy.  Most  often,  OODA  loops  are  used  to 
depict  competitive  engagements.  Achieving  a  faster  OODA  cycle  than  an  enemy  results  in  an 
ability  to  observe  and  react  to  unfolding  events  more  rapidly  than  an  opponent,  thereby  “getting 
inside”  an  enemy’s  decision  cycle  and  producing  a  competitive  advantage.  However, 
fundamentally  the  OODA  loop  as  a  conceptual  model  is  inherently  neutral.  Essentially,  OODA 
loops  represent  the  information  system  processes  of  a  complex  adaptive  system.  That  is, 
OODA  loops  can  be  applied  to  a  complex  adaptive  learner  acquiring  personal  knowledge  in 
cognitive  and  affective  domains  just  as  appropriately  as  they  can  be  applied  to  survival, 
adaptation,  and  competition.  This  makes  the  OODA  loop  a  desirable  model  or  meta-model  for 
social  learning  processes. 
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Figure  11:  Boyd’s  OODA  Loop,  adapted  by  William  P,  Hall 

(Reprinted  from  William  P.  Hall,  “Organizational  Autopoiesis  and  Knowledge  Management,”  2003,  5) 


This  broad  application  of  the  OODA  loop  as  a  model  for  learning  falls  in  line  with  Dr. 
Frans  Osinga’s  assessment  that  common  interpretations  are  “ineomplete”  and  that  “Boyd’s 
OODA  loop  eoneept,  as  well  as  his  entire  work,  are  more  eomprehensive,  deeper  and  rieher  than 

-5  £ 

the  popular  notion  of  ‘rapid  OODA  looping’  his  work  is  generally  equated  with.”  Exeellent 
baekground  of  John  Boyd’s  OODA  loop  grounding  in  seientifie  theory  is  found  in  Osinga’s 
Science,  Strategy,  and  War:  The  Strategic  Theory  of  John  Boyd/^ 

Finally,  this  researeher  reeommends  additional  researeh  into  how  distributed  learning 
environments  ean  be  improved  to  aeeount  for  affeetive  learning  eonsiderations  (poliey  awareness 
and  soeialization,  learner  motivation,  emotional  relationships  with  soeial  issues,  and 
enculturation  of  values)  and  not  just  information  transfer.  Multimedia  theory  ean  be  further 
investigated  to  determine  optimal  organization  and  presentation  of  online  information  regarding 
soeial  issues.  Distributed  learning  teehnologies  that  improve  learner  ability  to  eontrol  their  own 
learning,  ask  questions,  provide  feedback,  and  demonstrate  eompetence  for  real  world  seenarios 
should  be  pursued. 
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Appendix  A 


Summary  Analysis  Tables 

Table  2:  Air  Force  ADLS  Social  Policy  “Success”  is  Relative  to  Participant 


Air  Force 
ADLS 

Social  Policy 
Participant 

Role 

(Social 

Policy 

“verb”) 

Social  Policy  Goals 
(Successful  Outcomes) 

Relative 

Success 

Measures 

Social  Policy 
Maker 

•  Create 

•  Provide 
authority 

•  Specify 
vision 

•  Social  policy  that  is  known 

•  Social  policy  vision  becomes 
reality 

•  Effectiveness  of 
achieving  policy  maker 
goals 

•  Efficiency  in  achieving 
policy  maker 
effectiveness 

Air  Force 
Organization 

•  Adopt 

•  Promote 

•  Track 

•  Enforce 

•  Policy  maker  mandates  and 
requirements  are  met 

•  Air  Foree  is  organized,  trained 
(and  educated),  ADLS  equipped, 
and  mission  ready  on  soeial 
polieies 

•  Air  Force  personnel  are 
successful  with  soeial  issues  in 
the  real  world 

•  Effectiveness  of 
aehieving  Air  Force 
organization  goals 

•  Efficieney  in  achieving 
Air  Force  organization 
effectiveness 

ADLS 

Program 

•  Train 

•  Make 
available 

•  Air  Force  organization 
requirements  are  met 

•  Fearners  are  trained  on  soeial 
policy  via  ADFS 

•  ADFS  media  and  meehanism  is 
available  “anywhere,  anytime” 

•  Effectiveness  of 
aehieving  ADFS 

Training  and  Education 
goals 

•  Efficiency  in  achieving 
ADFS  program 
effectiveness 

Learner 

•  Learn 

•  Internalize 

•  Live  out  in 
behavior 

•  Air  Foree  organization 
requirements  are  met 

•  Social  policy  is  learned  on 

ADFS  (learner  is  trained) 

•  Social  policy  messages  are 
internalized 

•  Fearner  is  suceessful  with  social 
issues  in  the  real  world 

•  Effectiveness  of 
achieving  learner  goals 

•  Efficiency  in  achieving 
learner  effeetiveness 
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Table  3:  Summary  of  ADLS  Social  Policy  Makers,  Mandates,  and  Effectiveness 


ADLS  Social 
Policy  Course 
(Est  Duration) 

Social 

Policy 

Maker 

Social  Policy 
Area 

Directive 

Authority 

DoD  Social  Policy 
Mandate  (Goal)  with 
Regard  to  Social 
Policy  Training  & 
Education 

Intended 
ADLS  Course 
Audience 

ADLS 

Frequency  / 
Kind  of  Test 

"Effective" 
for  Social 
Policy 
Maker 
mandate? 

Communication 
Skills  (2  hrs) 

Conflict 
Management 
(2  hrs) 

Cross-Cultural 
Communication 
(3  hrs) 

Effective 
Feedback  (1  hr) 

Ethical  Decision¬ 
making  (3  hrs) 

Group 

Development 
Theory  (2  hrs) 

Perceptions 
(3  hrs) 

Socialization 
(4  hrs) 

Under 
Secretary  of 
Defense  for 
Personnel 
and 

Readiness 

Equal 

Opportunity 

(EO) 

Equal 

Employment 

Opportunity 

(EEO) 

Fluman 

Relations 

Sexual 

Harassment 

Participation 
in  Extremist 
Activities 

DoD  Directive 
(DODD)  1350.2.5.2 
(DEOMI  mandate) 

DoDD  1350.2: 

“Enhance  combat  and 
operational  readiness 
by  enhancing  unit  and 
organizational 
leadership  and 
cohesion.  This  is 
accomplished  by 
developing  and 
conducting  education 
and  training  in  the 
administration  of 
military,  EO,  EEO, 
and  human  relations” 

Open  to  all 
ADLS 

members  (not 
mandatory) 

No  mandatory 
ADLS 
frequency  / 
Comprehension 

Yes. 

Effective  as 
providing 
“educational 
materials  for 
EO,  EEO, 
and  human 
relations 
education” 

Annual  Ethics 
Training  for  OGE 
450/SF  278 
Filers  (1  hr) 

Secretary  of 
Defense 

(DoD 
General 
Counsels  are 
Designated 
Agency 
Ethics 
Officials) 

Ethics 

DoD  Directive 
5500.07 
“Standards  of 
Conduct” 

DoD  5500. 7-R, 
“Joint  Ethics 
Regulation” 

DODD  5500.07: 

“Ethics  training  is 
conducted  as  required 
within  the  DoD 
Component  command 
or  organization;  DoD 
5500.7-R:  Ethics 
training  is  “minimum 
of  1  hour  of  official 
duty  time” 

Initial  for  all 
new  DoD 
personnel; 
Annual  for 
specific 
positions 
(OGE  450/SF 
278  files, 
contract 
officers) 

One  time 
briefing  for  all 
new  DOD 
personnel  on 
entry.  Annual 
requirements 
for  specific 
positions  / 

No  test 

Yes.  DoD 
mandates 
are  met  to 
have  1  hour 
of  ethics 
training  for 
initial  DoD 
employees 
and  annual 
OGE  450/SF 
278  filers 
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Law  of  Armed 
Conflict  (1  hr) 

International 

T  reaty 
(Geneva 
Conventions) 

Congress 

Deputy 
Secretary  of 
Defense 

Secretary  of 
the  Air  Force 

Law  of  War 

Law  of  Armed 
Conflict 

Geneva 
Conventions, 
Articles  82,  87, 

127,  130,  144,  and 
147 

Goldwater-Nichols 
Act  of  1 986 

DoD  Directive 
(DODD)  2311. 01 E, 
"Law  of  War 
Program” 

Air  Force  Policy 
Directive  (AFPD) 
51-4,  "Compliance 
With  the  Law  of 
Armed  Conflict 
(LOAC)” 

Air  Force 
Instruction  51-401, 
"Training  and 
Reporting  to 
Ensure  Compliance 
with  the  Law  of 
Armed  Conflict” 

Geneva 

Conventions,  Article 

82  mandates  to 
signatory  states  a 
responsibility  to 
instruct  the  law  of 
armed  conflict  to  their 
respective  forces  and 
requires  this 
instruction  to  the  point 
of  familiarity  for  all 
ranks  and  positions. 

Geneva 

Conventions,  Article 

87  calls  for 
commanders  to 
ensure  their 
respective  forces  are 
trained  in,  and  adhere 
to,  the  law  of  armed 
conflict.  Geneva 
Conventions, 
Articles  127,  130, 

144  and  147  place  a 
duty  on  each 
signatory  to  train 
military  forces 
(disseminate  the  text 
of  the  Convention), 

"as  widely  as 
possible...  in  their 
programmes  of 
military  and  civil 
instruction.”  (sic); 
Goldwater-Nichols 
Act  of  1986 
mandates  service 
secretaries  to  provide 
trained  forces  to  the 

combatant 
commands;  DoD 
Directive  (DODD) 
2311. 01 E  requires 
heads  of  the  DoD 
components  to 
“institute  and 
implement  effective 
programs  to  prevent 
violations  of  the  law  of 
war  (also  known  as 
LOAC),  including  law 
of  war  training  and 
dissemination.” 

All  Airman  and 
emergency 
essential 
civilian 
personnel 

1  hour  for 
general 
population  via 
ADLS.  More 
time  for 
specialized 
training 
groups  e.q. 
AFOSI,  SF, 
Medical 
Personnel  and 
Chaplains  / 

7  intermediate 
quizzes  and 
final 

competency 
test  (70% 
criteria) 

Yes. 
Geneva 
Convention, 
Congress, 
DoD,  and 
CSAF 
mandates 
are  met 

No  Fear  Act 
Training  (30  min) 

Congress 

Federal  Anti- 
Discrimination 
and 

Whistleblower 

Protection 

Laws 

Equal 

Opportunity 
and  Treatment 

Sexual 

Flarassment 

Section  202  of  the 
"Notification  and 
Federal  Employee 
Antidiscrimination 
and  Retaliation  Act 
of  2002”  (No  FEAR 
Act) 

Section  202  of  the 

No  FEAR  Act 

requires  federal 
agencies  provide 
periodic  training  of 
employees  regarding 
their  rights  and 
remedies  under  the 
anti-discrimination 
and  whistleblower 
protection  laws. 

Federal 
employees, 
supervisors, 
managers  and 
military 
supervisors  of 
civilian 
employees 

Every  24 
months  (no 
exemptions)  / 
Final 

competency 
test  (70% 
criteria) 

Yes. 

Congress 
mandate  to 
train  and 
inform 
federal 
employees  is 
met 

33 


Human 
Relations 
(30  min) 

The 

President 

and 

Under 
Secretary  of 
Defense  for 
Personnel 
and 

Readiness 
(for  CTIP) 

Secretary  of 
the  Air  Force 
(forAFI  44- 
154) 

Combating 
Trafficking  in 
Persons 

Suicide 

Awareness 

Violence 

Prevention 

National  Security 
Presidential 
Directive  (NSPD)- 
22,  "Combating 
Trafficking  in 
Persons”, 

16  Dec  2002 

DoDI  2200.01, 

16  Feb  2007 
"Combating 
Trafficking  in 
Persons  (CTIP)” 

Air  Force 
Instruction  (AFI) 
44-154,  03  Jan 
2003,  “Suicide  and 
Violence 
Prevention 
Education  and 
Training” 

DoDI  2200.01: 

“Educate  all  Service 
members  and  DoD 
civilians  annually  on 
the  worldwide 
trafficking 

menace,  national  TIP 
policy,  overseas 
theater  TIP  policy, 
and  attendant 
personal 
responsibilities 
consistent  with  DoD 
core  values  and 
ethical  standards”; 

AFI  44-154:  “Unit 
commanders 
will  ensure  all 
personnel  complete, 
during  the  15-month 
Air  Expeditionary 
Force  (AEF)  training 
cycle,  a  mandatory 
suicide  prevention 
and  violence 
awareness  education 
program.  Completion 
of  program 
training  will  be 
documented  and  a 
tracking  mechanism 
developed  to  ensure 
training  is 
accomplished.” 

Mandatory  for 
all  Air  Force 
military  and 

US  Citizen  AF 
employees; 
optional  for 
contractors 
and  foreign 
employees 
(local 
nationals) 

Mandatory 
annually  / 

No  test 

Yes. 

Provides 

documented 

annual 

training 

(broad 

mandate) 

Homosexual 
Policy  Training 
for  CCs,  JAs, 
and  SF 

Personnel  (1  hr) 

Under 

Secretary  of 
Defense  for 
Personnel 
and 

Readiness 

DoD 

Homosexual 

policy 

Secretary  of 
Defense 
(Personnel  & 
Readiness) 
memorandum 
"Implementation  of 
Recommendations 
Concerning 
Homosexual 
Conduct  Policy," 

12  Aug  1999 

CSAF 

memorandum 
"Homosexual 
Policy  Guidance,” 

10  March  2000 

USD  (P&R)  Memo: 

“Ensure  that  Service 
Inspectors  General 
include  as  an  item  of 
specific  interest  in 
their  inspections  the 
training  of  those 
charged  with 
application  and 
enforcement  of  the 
policy  on  homosexual 
conduct  -  i.e., 
commanders, 
attorneys,  and 
investigators” 

Commanders, 
Judge 
Advocates, 
and  Security 
Force 

Investigators 

Annually  for 
commanders, 
judge 
advocates, 
and 

investigators  / 
No  test 

Yes. 

Provides 

annual 

training 

(broad 

mandate) 

Homosexual 
Policy  for 
Managers  (1  hr) 

Air  Force 
Supervisors 

One  time 
training  for  AF 
supervisors  / 
No  test 

Yes. 

Provides 

training 

(broad 

mandate) 
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Appendix  B 


Effectiveness  &  Efficiency  Success  Measures  for 
ADL  Systems  and  Organizations 


DoD  Success  Criteria  for  ADL 

("ADL  in  2012"  from  2000  DoD  Implementation  Plan  for  ADL  and 
"Elements"  from  1999  DoD  Strategic  Plan  for  ADL) 


•  Accessibility:  access  instructional  components  from 
one  remote  location  and  deliver  to  many  other  locations 

•  Interoperability:  use  instructional  components 
developed  in  one  location  with  one  set  of  tools  or 
platform  in  another  location  with  a  different  set  of  tools 
or  platform 

•  Adaptability:  tailor  instruction  to  individual  and 
situational  needs 

•  Durability:  operate  instructional  components  when 
base  tec_hnoloev  changes,  without  redesign  or  recoding 


•  Reusability:  incorporate  instructional 
components  into  multiple  applications 

•  Affordability:  increase  learning  effectiveness 
significantly  while  reducing  time  and  costs 


•  Common  industry  standards 

•  Interoperable  tools  and  content 

•  Robust  and  dynamic  network  infrastructure  for  distribution 

•  Supporting  resources 

•  Cultural  change  at  all  levels  of  command,  recognizing  that  learning  is  an  official 
requirement  of  the  duty  day 


ADL  TECHNOLOGY  FOCUSED 


Figure  12:  DoD  Success  Criteria  for  ADL 
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DoD  View  of  Organizational  ADL  Success 

(ADL  Initiative  ''Monitoring  and  Measuring  Progress" 
fronn  2000  DoD  Implementation  Plan  for  ADL) 


ADLS 

Effectiveness 

Metrics 


•  Balance  content  development  and  distribution  with 
infrastructure  development? 

•  Develop  management  software  that  is  robust  enough 
to  record  and  manage  student  progress  anytime  and 
anywhere  it  is  needed  (learning  management  systems)? 

•  Develop  products  that  will  be  operable  (given  rapidly 
changing  technological  environment)  for  the  next  three 
years? 

•  "Interoperate"  with  other  distributed  learning 
programs  across  Department  of  Defense? 

•  Support  education,  training,  and  on-the-job 
performance  aids? 

•  Support  the  needs  of  active  and  reserve  components? 

•  Support  the  needs  of  the  joint  community? 


•Yield  a  reasonable  return  on 
investment  in  terms  of  readiness 
and/or  savings  within  five  years? 

•  Include  provisions  to  assess  and 
document  the  costs  and  benefits  for 
the  first  three  years  after  fielding? 

•  Make  a  deliberate  attempt  to 
collaborate  and  leverage  investments 
of  others  within  and  outside  the 
Department  of  Defense? 


ADL  FUNDING.  PROGRESS,  AND  METRIC  FOCUSED" 


ADLS 

Efficiency 

Metrics 


Figure  13:  DoD  View  of  Organizational  ADL  Success 
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